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Abstract 

This paper explores seasonal and long-memory time series proper- 
ties by using the seasonal fractional ARIMA model when the seasonal 
data has one and two seasonal periods and short-memory counter- 
parts. The stationarity and invertibility parameter conditions are es- 
tablished for the model studied. To estimate the memory parameters, 
the method given in Reisen, Rodrigues and Palma (2006 a,b) is gen- 
eralized here to deal with a time series with two seasonal fractional 
long-memory parameters. The asymptotic properties are established 
and the accuracy of the method is investigated through Monte Carlo 
experiments. The good performance of the estimator indicates that 
it can be an alternative competitive procedure to estimate seasonal 
long-memory time series data. Artificial and PMio series were consid- 
ered as examples of applications of the proposed estimation method. 
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1 Introduction 

Time series exhibiting seasonal or cyclical characteristics are very common in 
economics, hydrology, and many other disciplines. As a consequence, several 
methodologies have been developed to deal with these features. One of the 
most well known of these tools is the class of seasonal autoregressive inte- 
grated moving average (SARIMA) process. This model can describe many 
time series containing a mixture of seasonal phenomena of different periods. 
It is well known that many series may contain a persistent seasonal structure 
along with a long run trend. However, the case of more than one seasonal 
(non-zero) structures has not very much studied. In this direction, the study 
of the ARFIMA process with seasonal periods becomes an interesting re- 
search topic, and this is the main motivation of this work. 

Let X t = {Xt}tez be a time series with a zero mean and a constant 
variance. A multiple seasonal ARIMA model can be written as follows: 

M N 

H<P J (B)V d (B)X t = l[e e (B)e t , (1) 

j=l 1=1 

where V d (-B) = nf=i(l — B Si ) di , M and N are, respectively, the number 
of factors of the AR and MA components, d{ G IN , i = l,...,k, is the 
differencing parameter and k is the number of differencing factors, Sj is the 
i-seasonal period, BX t = X t _i, and e t is a white noise process with zero- 
mean and variance g\. <pj(B),j = 1,...,M, and 8e(B),£ = 1,...,N, can 
also be polynomials with seasonal effects. The stationarity and invertibility 
properties of model ([I]) are established based on certain parameter conditions. 
The multiple seasonal ARIMA model belongs to a class of models with a 
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general difference operator given by 

L 

V d (B) = - Be lXe )(l - Be~ lXe )} de , (2) 

l=\ 

where now dg e R [di > — 1) and it is defined as the fractionally differencing 
parameter and A^, I = 1, L, are fixed frequencies in the range [— 7r, 7r]. For 
suitable choices of the fractional parameters, time series models with filter 
given in ([2]) may have a finite number of zeros or singularities of order di,...,di 
on the unit circle which allows the modeling of long and short memory data 
containing seasonal periodicities. In the time domain, the usual definition of 
long memory is the non-summability 

oo 
h=0 

where ^(h) is the autocovariance at lag h of the process, whereas, in the fre- 
quency domain, this property is defined by the fact that the spectral density 
of the process becomes unbounded at some frequency in [0,n]. 

A time series with both seasonal and non-seasonal fractional differencing 
parameters has a spectral density specified by 

f(\) = r(\)\\r 2d flf[\x- \ t ,\- 2d % (3) 
i=i j=i 

where di £ R (di > —1), A G (— 7r, it], /*(A) is a continuous function, bounded 
above and away from zero and Ay ^ are poles for j = 1, £j, % = 1, /c. 
Processes with a spectral density given by ([3]) have been discussed by Arteche 
and Robinson (1999), Giraitis and Leipus (1995), Leipus and Viano (2000), 
Palma and Chan (2005) and Palma (2007, Ch.12), among others, to model 
time series with seasonal and cyclical long-memory behavior. 

The main interest in models which have filter ([2]) and spectral density 
of the form (J3J) is related to the estimation of fractional memory parameters 
di,...,di- Ray (1993) used IBM product revenues to illustrate the usefulness 
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of modeling seasonal fractionally differenced ARMA models by allowing two 
seasonal fractional differencing parameters in the model, one at lag three 
and the other at lag twelve. Other papers related to this topic are, for ex- 
ample, Hassler (1994), Gray et al. (1989,1994), Giraitis and Leipus (1995), 
Ooms and France (2001), Woodward et al. (1998), Arteche and Robinson 
(2000), Palma and Chan (2005) and Reisen et al. (2006a,b), Gil-Alana (2001) 
among others. Hassler (1994) introduced the rigid and flexible filters and an 
application of this methodology to the economic activities in the Euro area 
is discussed in Ferrara and Guegan (2006). Arteche and Robinson (2000), 
Arteche (2002) and Arteche and Velasco (2005) dealt with robust semipara- 
metric estimators and testing procedures for the seasonal fractional memory 
parameter. Woodward et al. (1998) extended the Gegenbauer ARMA pro- 
cess (GARMA). Independently of these works, a time series model for fitting 
long or short-memory data containing seasonal periodicities was introduced 
by Giraitis and Leipus (1995) which is called the Fractionally Autoregres- 
sive Unit Circle Moving Average model (ARUMA). These authors discussed 
the asymptotic properties of the ARUMA model and the estimation of its 
parameters. 

Another equally relevant publication related to the asymptotic proper- 
ties of seasonal and periodic time series is the work by Viano et al. (1995). 
Reisen et al. (2006a,b) dealt with the estimation of the seasonal ARFIMA 
model with long-memory innovations (SARFIMA (0, d, 0) x (0, D, 0) s ) by us- 
ing different estimation procedures for the seasonal and non-seasonal memory 
parameters, that is, for D and d respectively. The estimators are based on the 
multilinear regression equation of log/(-), where /(•) is the spectral density 
of the process satisfying /(A) ~ C*\\\~ 2 ^ d+D ' as A — > 0, where C* is a positive 
constant. Necessary conditions that guarantee the stationary and invertibil- 
ity of the model were also established. Through Monte Carlo experiments, 
they compared their proposed methodology with other well-known paramet- 
ric estimation procedures such as the Whittle and the maximum likelihood 
methods. The empirical evidence showed that the multilinear regression es- 
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timators are very promising. 

Most of the works referred to above deal with the estimation of one sea- 
sonal long-memory parameter. However, in many practical situations the 
time series exhibits more than one seasonal component. In order to explore 
these more complex situations, this paper focuses on the estimation of models 
containing one and two seasonal periods which encompass long and short- 
memory dependence structures. Specifically, an ordinary least squares (OLS) 
procedure, based on a log-periodogram regression, is proposed to estimate 
all fractional parameters simultaneously. 

Let now X t = {X t } te % be a zero-mean time series defined by 

V d {B)X t = (1 - £? Sl ) dl (l - B S2 ) d -X t = v u (4) 

where the vector d =(di,d 2 )', Si and s 2 are seasonal periods and di,d 2 G R 
(di > — 1) are their seasonal memory parameters, respectively, and v t has a 
spectral density that satisfies the following assumption. 

Assumption 1: The spectral density of v t satisfies as A — > 

U (jy- + a) = U + c k \\\ a * + 0(|Ar +t ) 

for some i > 0, f u>k = f„(^r), k = 0, 1, [s'/2], s' = max(si,s 2 ) = s x 
(without loss of generality) and a k = «i for k = 0,s'/2 (if s' even) and 
tt/c = oi2 otherwise. If v t is a stationary and invertible ARMA process then 
a.\ — 2, ol-i — 1 and i — 1. In this case, the process X t is usually defined as 
Seasonal ARFIMA (SARFIMA) model. 

In the next section some properties of the model given by (j4j) are dis- 
cussed. In particular, the stationarity and invertibility conditions of Model 
01]) are established in Proposition 1. The estimation of these models is dis- 
cussed in Section 3, where the proposed ordinary least squares (OLS) es- 
timator is introduced. Some asymptotic properties of these estimators are 
established in Theorems 1 and 2. For example, the proposed OLS estimator 
is shown to be asymptotically unbiased and normally distributed. For com- 
parison purposes, the quasi-likelihood Fox-Taqqu estimator (Fox and Taqqu 
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(1986)) is adapted here for Gaussian seasonal long-memory processes. The 
comparison between parametric and semiparametric approaches may appear 
to be unfair for the former class, in the case of a correct and complete para- 
metric specification. So, the misspecification problem of the FT method is 
also included to be a part of the simulation section. The finite sample per- 
formance of the proposed estimator is investigated in Section 4 while Section 
5 discuss some applications. Final remarks are presented in Section 6. 



2 Model properties 

Let Xt be a time series process defined by (J4]). For simplicity, it is assumed 
that Sx and S2 are even numbers. The fractional di difference is a generaliza- 
tion of the binomial expression (1 - B) d and it can be written as 



oc 



where 



[I -B Si ) di = 22 7T kB ks 

k=0 



T(k - di) 



and T(-) is the Gamma function. 

In the literature of the seasonal long-memory process, there are some spe- 
cific time series models of interest obtained from the solution of the general 
fractional operator (J2J) and the spectral density of form The specific 
filters and their models are: (a) (1 — B) d is the filter of the fractional in- 
tegrated 1(d) process see, for example, Hosking (1981), among others; (b) 
(1 - B) dl (l - B s ) d2 is the filter in the SARFIMA process that has been ex- 
plored in the literature of seasonal fractional ARMA model, see for example, 
Porter-Hudak (1990), Hassler (1993), Arteche (2002), Arteche and Robinson 

(2000) and Reisen et al. (2006a,b); (c) (1 - v x B v v B d ) is the filter 

that belongs to the ARUMA and fc-GARMA processes, proposed by Giraitis 
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and Leipus (1995) and independently by Woodward et al. (1998), respec- 
tively; (d) (1 - B 3 ) dl {l - B l2 ) d2 is the filter used by Ray (1993) to model 
and forecast a monthly IBM revenue data under the restriction d\ + d 2 — 1. 

Returning to our specific model of interest for X t given in the filter 
may be written as follows: 

2 & 

(1 -B 8l ) dl (l -B S2 ) d2 = ] Be iXi i)(l- Be- iXi i)] di i, (5) 

i=X j=0 

where Xij — ^ (j — 0, 1, . . . £i) are the frequencies of the period i, & = 4f 
(i = 1, 2), and 



dy = c?i when Ay ^ X 2 j, 0, 7r; 

dy = di/2 when Ay 7^ \ 2 j and Ay = 0, 7r; 

+ d 2j = when Ay = X 2j = 0, vr; 

dy + ^2j = d 1 + d 2 when Ay = A 2 j 7^ 0, ir; 

and similarly when i = 2 

It is easy to show that the filter ((5]) is a particular case of the operator 
02]) by using the equality 



l-z s = (l-z)(l + z)Y[(l-ze 27rik/s )(l-ze- 27Tik/s ), for s even. 

1 

When s is an odd number, the term (1 + z) does not appear in the above 
equation. From the expression of 1 — z s , the following proposition is reached: 

Proposition 1. Let the process X t be a solution of equation 

X t = (1 -B Sl )~ dl {l -B S2 )~ d2 v u (7) 

where v t is a covariance stationary ARMA process ( v t = §^§yQ), £t is an 
i.i.d Gaussian sequence with zero mean and variance of , and di G R is the 
fractional parameter at seasonal period s, for i = 1,2. Then, 
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(a) The process X t is stationary and invertible if\di + d,2\ < 1/2 and \di\ < 
1/2,2 = 1,2. 

(b) The spectral density of X t is given by 

/(A) = /,(A)nlint=o|2/n(^)2sin(^)|-^ 
= (2 sin *§i) Ml (2sin^f) ^ 

where f u (X) (0<X<n)is the spectral density of v t , Ay = i — 1,2 
and j = 0, 1, and dij are given by (EJ). 

(c) Assuming that max{dy} > 0, the asymptotic autocovariance of Xt, 
j(h) = E(X h X ), is given by 

2 & 

7(/i) = ^2^2aij \ h l^'j' 1 (cos hXij + o(l)) as k -»■ 00, 
i=i j=i 

where 

{a- ■ Ay = 0, 7T 
2ay < Xij < it, 

d^ is specified as in (EJ) and 



a : 



f\( p -2n\ij\ 2 

> 12 ° e -r(l-2^)sin( C i ij 7r)A 2 



where 



2 sin Ay I d ^ I 2(cosAy - cosA«) | d «, < Ay < vr, 

\\ m I 2(C0S Ay - COS Xu) \~ du , Xij = 0, 7T. 



Proof, (a) As previously noted, filter (J3J) is a particular case of (|2]) which 
is the operator of the ARUMA(p, d±, d^, q) model where p and q are the 
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polynomial orders of a stationary and invertible ARMAQo, q) process. From 
Theorem 1 of Giraitis and Leipus (1995), the ARUMA (0, d\, di, 0) process 
is stationary and invertible if the fractional parameters de, £ = 1, L, in (J2J) 
satisfy \de\ < 1/2 when A^ ^ 0, ir and \dg\ < 1/4 otherwise. From this fact 
and by means of equations (jSJ) and it is straightforward to establish 
the stationary and invertibility properties. The proof of (b) is immediately 
obtained from ([3]) and Theorem 2 in Giraitis and Leipus (1995). This theorem 
is also used to prove the asymptotic covariance given in (c) where dij is defined 
by ©. 

□ 

3 Seasonal fractional parameter estimators 

This section deals with the estimation method based on the regression equa- 
tion of log /(A) to obtain the estimates of model ([7]). Since the procedure 
proposed here provides simultaneous estimates for multiple seasonal memory 
parameters, the method is a more general approach than those discussed in 
Reisen et al. (2006a,b) and related references. Let n be the sample size 
and let X\, . . . , X n be a realization of the process defined by where 
v t is a Gaussian ARMA process. The well-known periodogram function 
/(A) = (27rn) _1 | Y^t=i X t e zXt \ 2 is an asymptotic unbiased and inconsistent 
estimator the spectral density and it is the standard estimator used in time 
series modeling. 

3.1 The OLS regression estimators 

The fractional memory OLS estimators are the slope estimators of the mul- 
tiple regression equation 

log I k j = a k - 2d 1 \ogX 1Aj - 2d 2 \ogX 2Aj + V kJ , k = 0, 1, [s'/2], (8) 
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where s' = max(si, S2), j = l,...,m ( m G IN*) if k = 0, j — —l,...,—m 
if k = s'/2 (s even) and j = ±l,...,±m otherwise, I k j = I(2irk/s' + Xj), 
Xj = 2irj/n is the Fourier frequency, [■] means the integer part and 

a k = log f v>k + E ^log ^) 
Vk,j = + 
Uhj = log ^ -£ flog 

euj = log f -^±M =6fcA ? + 0(A? +t ) 

Xi,k,j = 2 sin 

X 2jfej - = 2 sin 

for /fcj = / (^jr + Aj) and bk = Ck/f v ,k- The regression equation flSJ) is easily 
derived from the expression of the log /(A) where /(A) is the spectral density 
given in Proposition 1. To avoid the estimation of the constants a k , the 
variables are locally centered such that the estimates are obtained by least 
squares in the regression model 

Ykj = diZi^j + d 2 Z 2j k,j + V k *p (9) 

where V kj = V k ,j - ^Y?j V k,j for m k = S k m with 5 k = 1 for k = 0,s'/2 
and 5k = 2 otherwise and the sum Y2* runs for j = 1, m if k = 0, j = 
— 1, — m if = s'/2 and j = ±1, ±m otherwise. Y k j, Zi^j and ^2,fcj 
are the locally centered dependent variable and regressors in (JSJ) similarly 
defined. The local centering is needed here because the regression model in 
(jHJ) has different constants depending on the frequency bandwidth. A global 
centering can be used only if a% — ... — ar s '/2] which holds for example if v t 
is a white noise process with a constant spectral density function. 

The estimation procedure based on the above regression equation is mo- 
tivated by the pioneer regression estimator proposed by Geweke and Porter- 
Hudak (1983) for the ARFIMA model. Since the introduction of the method, 




£2 
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2nk , 
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it has became one of the most popular estimation procedures and its empirical 
and asymptotic properties have been well established. Robinson (1995) and 
Hurvich, Deo and Brodsky (1998) proved that the GPH-estimator is consis- 
tent and asymptotically normal for Gaussian time series processes. Hurvich 
et al. (1998) also established that the optimal bandwidth is of order 0(n 4 ^ 5 ). 

When the model is a SARFIMA(0, d, 0) x (0, d s ,0) s process, Reisen et 
al. (2006a,b) proposed different estimation methods for d s and d. Basically, 
the regression estimators considered in their study are distinguished by the 
choice of the bandwidth when regressing log[J(A)] on log[2 sin(As/2)] and 
log[2 sin(A/2)]. Following the same direction, their study is generalized here 
in the case where the model has two seasonal fractional parameters d\ and 
g?2 for the seasonal periods s\ and S2, respectively. 
Assumption 2: s\ is a multiple of S2- 
Assumption 3: Let m = m(n) is a sequence satisfying 




log m H > as n — > oo 

m 



for some i > 0. 



Assumption 4: 



m 



a* +0.5 



a* 



— > K as n — > oo 



n' 



where a* = min(ai,a 2 )- 



Theorem 1. Under assumptions 1,2 and 3, as n — > oo 



E(d)-d = Q~ l b n (l + o(l)) 



Var(d) = m 



-i 



Q-\l + o(l)), 
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where 
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Q 



where Ik = {0,k such that ks2 is a multiple of s' }, 5k = 1 for k = 0, s'/2 
and 5k = 2 otherwise. In consequence, d is consistent. 

Theorem 2. Under assumptions 1, 2, 3 and 4, as n oo, 



for 



. 2(27 r)^^— iff £** 6 *** 



where </& = {k such that = a*}. 

Proofs of the above theorems are in Appendix A. 

As a particular case of ModelEl the statistical properties of the SARFIMA(0, d, 0) < 
model, with v t = e<, are now discussed. 
The OLS estimator of d is given by 

S= (-o.^p^-*^, (10) 

where j = log {2 sin((sAfcj/2)}. By simple algebra, the following expres- 
sion is reached. 

-, If 1 m 

d~ d « -— £ " (11) 

where Sx 1 x 1 = SL=o Ej"t^i,fe,j — -^i) 2 an d J is defined as in (jSJ). 

Proposition 2. Let X t be a SARFIMA(0, d, 0) s mode/ and d is the OLS 

estimator of d provided by (TI77|). Under assumptions 1 to 4, as n — >■ oo, 

£(d) « d. 
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(b ) The variance of the estimator is given by 



7T 2 



Var(d) » — . (12) 



(c) The estimate d satisfies 

>/ro(d-<Q4jv(o,|^. 



Proof. The above results are particular cases of Theorem 1 and coincide 
with Theorems 1 and 2 in Hurvich, Deo and Brodsky (1998). Note that the 
variance of the estimator suggested in Porter-Hudak (1990) and Ray (1993) 
is approximately 4sVar(d). □ 



4 Finite sample investigation 

The finite sample performance of the estimator discussed previously is investi- 
gated in this section through Monte Carlo experiments for different structures 
of Model [7] where v% follows a SARMA model. To generate the models, the 
procedure used is the one suggested in Hosking (1984) with i.i.d innovations 
from a N(0,1) distribution. The models are: SARFIMAQo, d\, q) Sl (P, o^, Q)s 2 
with p — P — 0, 1, si = 1,4, S2 = 4, 12 and the AR non-seasonal (0i) and 
seasonal (<f) s ) parameters with values <f)i=4> s = 0.0, 0.3 and 0.8. The parame- 
ters are also displayed in the tables. The empirical investigations were based 
on sample size n = 1080, and the sample quantities mean, correlation and 
mean squared error (mse) of the estimators were calculated over 2,000 repli- 
cations. The calculations were carried out by means of an Ox program in an 
AMD Athlon XP 1800 computer. 

Since the models also involve short-range dynamics, the regression esti- 
mators were obtained by using different bandwidths. In the case where the 
model has not AR contribution, the bandwidth m = \ — r] f^ — \] was fixed. 
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In this context, the regression estimator (GPHt) becomes a parametric pro- 
cedure. For the models with short-memory dynamics, the two bandwidths 
m = n ai , ai — 0.5 and 02 = 0.3 were used, and the estimators are denoted 
as GPH\ and GPH2, respectively. The bandwidth n ' 5 is here considered 
because this specification has been widely used in the case of ARFIMA mod- 
els with short-memory components, while the choice of ra 3 is based on the 
empirical investigation discussed below. 

For a comparison purpose between semiparametric and parametric ap- 
proaches, the procedure due to Fox and Taqqu (1986) (FT), which possesses 
good asymptotic properties, is also adapted here for Gaussian seasonal long- 
memory processes. This estimator is obtained by using all harmonic fre- 
quencies between the seasonal frequencies. It is calculated by minimizing 
the approximate Gaussian log-likelihood 

£ "(<>) = ^£{M(A,) + ^}, (13) 

where /(A) is the spectral density, denotes the vector of unknown param- 
eters and Ylj is the sum over j = 1 , . . . , n — 1 , excluding those values Xj 
coinciding with the seasonal frequencies. Under some conditions, the FT 
estimator for non-seasonal ARFIMA models, is asymptotically normal and 
consistent, and for Gaussian process, the estimator is also asymptotically 
efficient (Giraitis and Surgailis, 1990, Fox and Taqqu, 1986 and others). By 
assuming that the poles of the spectral density f(Xj) are known, the asymp- 
totic theory for the FT method can be extended to the SARFIMA model (see 
the discussion in Arteche and Robinson(2000), Section 2). It should be noted 
that the focus of this paper is to estimate the seasonal fractional parameters 
only even though the parametric FT method also provides estimates for the 
AR parameters. 

Table [1] summarizes the results for the SARFIMA model with d\ = 0.3 
(si = 4). The first part of this table shows the performance of the regres- 
sion methods when there is no seasonal AR contribution. For the case of 
0i = 0, GPHt has the best performance among the GPH based ones, which 
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is an expected result since the method uses all non-seasonal frequencies in 
the regression equation and in this sense it is parametric and comparable 
to the FT. The effect of the bandwidth is also a motivation of this study. 
The reduction of the bandwidth causes an increase in the mse, especially 
when <pi= 0. This is a not surprising result, since the AR contribution is 
mainly concentrated at zero frequency. The absence of short-memory com- 
ponent allows a wider bandwidth because the bias is quite controlled. Thus, 
a reduction of m implies a larger variance and does not reduce the bias. 

In the second part of the table, the estimates were computed when the 
model has the AR contribution at the seasonal period s — 4. From this, the 
GPH estimates are more affected by the AR component than the previous 
case, the bias is strongly positive and the mse also increases. In this case the 
AR component has spectral power not only at frequency zero but also at the 
seasonal ones, affecting to a greater extent the estimation of d\. The small 
value of the bandwidth mitigates the effect of the short-memory parameters. 
This is clearer when 4 changes from 0.3 to 0.8. Hence, in this context, the 
decrease of the bandwidth produces reduction on the size of the bias and the 
mse. 

In general, the FT estimates outperform the GPH estimates in terms of 
the mse, which is not surprising considering the parametric nature of the 
FT method in a correctly specified model. However, the FT estimates also 
present a significant increase of the bias when the model has AR seasonal 
components. The bias of the estimates also increases substantially when 
there is model misspecification, as can be seen from the examples presented 
in Tables H] and [51 The misspecification problem will be discussed in the end 
of this section. 

The following tables present the estimates when the models have more 
than one fractional parameter. Thus, the sample correlations between the 
estimates were also calculated. 

Table [2] displays the result when the models are SARFIMA (l,d 1 ,0) si 
(l,d 2 ,0) S2 with cZi =0.1(si = 1), d 2 = 0.3(s 2 = 4), fa = 0.0, 0.3, 0.8 and fa= 
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Table 1: Results for the seasonal ARFIMA model with d\ = 0.3 (s\ = 4) and 
<f) 8 , s = 1,4, n = 1080. 
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0.3, 0.8 whereas Table |3] shows the performance of the estimates when the 
SARFIMA model has seasonal periods s± = 4 and S2 = 12. From Table [2] it 
should be noted that the contribution of the parameter d\ is mainly at zero 
frequency. Hence, in general, the semiprametric estimators perform similarly 
to the previous case that is, the estimate of d depends on the the values 
of the bandwidth and of the AR counterpart. The memory parameters are 
estimated simultaneously, thus there is a balance effect between the two esti- 
mates d\ and d^ which justifies the negative correlation values between them. 
In addition, the estimates are balanced to have the value of d\ + d^ approx- 
imately equal to d\ + 62 which is the total memory at zero frequency. The 
correlations between the GPH estimates increases with the bandwidth and 
the AR coefficients. As was expected, the FT method presents superiority 
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performance compared with the semiparmetric approaches. 
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0.2997 
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GPHi 


0.2208 


0.0388 


-0.5415 


0.3004 


0.0062 






4>i = 0.8 


GPH 2 


0.1257 


0.1607 


-0.5190 


0.3148 


0.0375 








FT 


0.1069 


0.0148 


-0.0868 


0.2819 


0.0014 


0.7857 


0.0124 




GPHi 


0.1074 


0.0249 


-0.4751 


0.3404 


0.0083 






4>i = 0.3 


GPH 2 


0.1107 


0.1299 


-0.4233 


0.3037 


0.0348 








FT 


0.1006 


0.0006 


-0.0780 


0.1828 


0.0404 


0.4135 


0.0393 




GPHi 


0.1045 


0.0285 


-0.5011 


0.7269 


0.1874 






04 = 0.8 


GPH 2 


0.0445 


0.1591 


-0.4773 


0.4251 


0.0549 








FT 


0.1073 


0.0011 


-0.2241 


0.2422 


0.0079 


0.8183 


0.0035 



Although the model in Table [3] has fractional parameters at seasonality 
periods 4 and 12, similar conclusions of the performance of the estimates to 
the previous cases are observed. 
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Table 3: Results for the SARFIMA model with d-y = 0.1 (si = 4), d 2 = 0.3 
(s 2 = 12), <f>„ s = 1,4, 12 and n = 1080. 
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0.1022 


0.0007 


-0.2856 


0.2637 


0.0021 








GPHi 


0.1063 


0.0061 


-0.5230 


0.3017 


0.0022 






01 = 0.3 


GPH 2 


0.0797 


0.0433 


-0.5446 


0.2954 


0.0119 








FT 


0.1012 


0.0009 


-0.3759 


0.2630 


0.0023 


0.2992 


0.0008 




GPHi 


0.1468 


0.0067 


-0.5212 


0.2861 


0.0030 






0i = 0.8 


GPH 2 


0.1177 


0.0374 


-0.5767 


0.2861 


0.0136 










FT 


0.1010 


0.0008 


-0.1308 


0.2619 


0.0023 


0.7996 


0.0004 




GPHi 


0.2043 


0.0160 


-0.4707 


0.2813 


0.0020 






cp 4 = 0.3 


GPH 2 


0.1146 


0.0338 


-0.4223 


0.3019 


0.0084 








FT 


0.0609 


0.0319 


-0.1445 


0.2575 


0.0028 


0.3430 


0.0296 




GPHi 


0.5962 


0.2528 


-0.4792 


0.2618 


0.0038 






4>i = 0.8 


GPH 2 


0.2634 


0.0625 


-0.5317 


0.2912 


0.0130 








FT 


0.0754 


0.0234 


0.1184 


0.2343 


0.0054 


0.8121 


0.0203 




GPH Q1 


0.1055 


0.0062 


-0.5344 


0.5044 


0.0439 






0i 2 = 0.3 


GPH Q2 


0.1255 


0.0481 


-0.6629 


0.3480 


0.0161 








FT 


0.1010 


0.0008 


-0.0427 


0.2881 


0.0031 


0.3341 


0.0311 




GPH ai 


0.0863 


0.0063 


-0.4587 


1.0064 


0.5010 






012 = 0.8 


GPH a2 


0.1089 


0.0354 


-0.5466 


0.7553 


0.2187 








FT 


0.1071 


0.0017 


-0.2963 


0.1859 


0.0197 


0.8190 


0.0042 



As an additional illustrative form to observe the method's performance, 
the box-plots in Figures [T] and [2] show the variation of the estimates for the 
model in Table |3] with <pi = 0.0 and 0>i = 0.3, respectively. 
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Figure 1: Box-plots of the estimates of d\ (a) and d 2 (b) for the SARFIMA 
model with d x = 0.1(si = 4), d 2 = 0.3(s 2 = 12) and = 0.0. 




Figure 2: Box-plots of the estimates of d\ (a) and d 2 (b) for the SARFIMA 
model with d x = 0.1(si = 4), d 2 = 0.3(s 2 = 12) and <f) x = 0.3. 

The asymptotic distribution given in Theorem 2 is also empirically inves- 
tigated for the model in Table |3] with = 0, and the results are depicted 
in Figure [3] which presents the empirical densities of the standardized GPH 
estimates of a SARFIMA model. These figures are examples to support the 
claim given in Theorem 2. The empirical densities of the estimates appear 
to be fairly close to the density of N(0,1) distribution. 
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(a) (b) 
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Figure 3: Empirical densities of the standardized GPH estimates of d\ (a) and 
d 2 (b) for the SARFIMA model with d Y = 0.1(si = 4) and d 2 = 0.3(s 2 = 12) 

Model Mis specification 

As previously mentioned, the FT method was included in the study to 
compare the finite sample property between semiparametric and parametric 
approaches. This comparison would be unfairly biased against the semipara- 
metric estimator proposed here if the empirical investigation was only based 
under correct model specification. Then, the next two tables deal with the 
estimation of the model under model misspecification of some models consid- 
ered in Tables [2] and [3j The simulated models have AR parts whereas these 
short-memory parameters are omitted in the estimated models. Thus, the 
order misspecification is related to the non specification of the short-memory 
dynamics in the estimated model. Tables H] and [5] give the FT estimates for 
the SARFIMA(0, d\, 0) Sl (0, d 2 , 0) S2 models with periods si = 1 and s 2 = 4 
and si = 4 and s 2 = 12, respectively. 

In contrast to the study presented in Tables [2] and [3l an order misspecifica- 
tion, however, radically alters the performance of the parametric FT method 
and the semiparametric GPH here proposed tends to perform significantly 
better. The FT estimates are highly biased. It is not surprising that the 
significative increase of the bias and mse are closely related to omitting the 
seasonal or non-seasonal AR value. For example, in the first two cases of 
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Table HJ the order misspecification is due to the non-seasonal short-dynamic 
part. It produces a significative positive bias of the non-seasonal memory 
parameter (di) whereas the estimate of d 2 is much less affected. The bias 
and the mse increase significantly when the seasonal or non-seasonal AR pa- 
rameter is close to the non- stationary region. In the second part of Table HI 
the results are on the contrary to the estimation performance of the vector d 
observed in the first part of the table. Because the short-term contributions 
are now at a seasonal period, the estimate of the memory parameter at s = 4, 
d 2 , is much more affected than d\. 

In Table the slowly decaying autocorrelations are at period lags Si = 
and s 2 =12. The performance of the parametric FT method is very similar to 
that previously considered. The biases of the seasonal memory parameters 
are directly related to the period and magnitude of the AR seasonal and 
non-seasonal coefficients. 

Table 4: Results of FT estimates of SARFIMA(0, d\, 0) S1 (0, d 2 , 0) S2 models. 
The true SARFIMA models have the parameters d\ = 0.1 (si = 1), d 2 = 0.3 
(s 2 = 4) and (f) s , s = 1,4, n = 1080. 
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mean 
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0i = 0.8 
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0.0990 


0.0008 


-0.1641 


0.5193 


0.0488 


04 = 0.8 


0.1063 


0.0014 


-0.4924 


1.0398 


0.5485 
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Table 5: Results of FT estimates of the SARFIMA(0, d x , 0) Sl (0, d 2 , 0) S2 mod- 
els. The true SARFIMA models have the parameters d\ = 0.1 (si = 4), 
d 2 = 0.3 (>2 = 12) and <f> 8 , s = 1,4 and 12, n = 1080. 



4>s 


di 


Corr. 


d 2 


mean 


mse 


mean 


mse 


0i = 0.3 


0.1079 


0.0010 


-0.1582 


0.2600 


0.0026 


0i = 0.8 


0.4344 


0.1146 


-0.0411 


0.1718 


0.0184 


04 = 0.3 


0.3355 


0.0562 


-0.2795 


0.1968 


0.0118 


04 = 0.8 


0.8647 


0.5855 


-0.1354 


0.1748 


0.0168 


012 = 0.3 


0.1059 


0.0007 


-0.0739 


0.5068 


0.0435 


012 = 0.8 


0.1158 


0.0018 


-0.5797 


1.0035 


0.4962 



5 Examples of Application 

This section illustrates the usefulness of the SARFIMA model and the semi- 
parmetric fractional estimator using three examples. The first two examples 
are artificial series and the third example consists of the analysis of daily 
average PM 10 concentrations. 

5.1 Artificial data 

Samples, with sizes n = 1080, from models SARFIMA(0, di, 0) S1 (0, d 2 , 0) S2 
(Model I) and SARFIMA(1, d x , 0) S1 (0, d 2 , 0) S2 (Model II), with d x = 0.1(s t = 
4), d 2 = 0.3(s2 = 12) and 04 = 0.3, were simulated according to the data 
generating process described in the previous section. The non-zero AR pa- 
rameter is the only factor that differentiates the two models. So, the influence 
of a short-memory parameter in the estimation of the fractional memory pa- 
rameters of a single series is the main purpose of the analysis of these artificial 
data sets. The sample autocorrelation functions (ACF) are in Figures H^a) 
and (b) for Models I and II, respectively, and the estimates of the models are 



22 



in Table El 



20 40 GO 80 100 

lag 

Figure 4: (a) Sample ACF of Model I (b) Sample ACF of Model II. 

Model I does not have the AR part. As expected, the ACF only has 
significant spike at lags which are multiples of 4 and 12, and they appear 
to have a slow decay pattern (see Figure Hh). The seasonal autocorrelations 
related to the fractional parameter d\ (si = 4) only become insignificant 
after lag 40. So, if the data had been analyzed with no prior information, 
inspection of the sample autocorrelation would indicate that the series has 
seasonal periods s = 4 and 12 with possible long- memory structure. As 
can be seem in Figure Hb, even though both models have the same seasonal 
long-memory parameters, an introduction of a positive AR coefficient may 
produce a significant impact on the correlation structure. The ACF of Model 
II (FigureHb) also shows slow decaying behavior at seasonal periods, however, 
with a stronger correlation structure at and between the seasonal periods 
than Model I and, in general, the patterns of this ACF are more complicated. 

Apart from the usual steps for the identification of a single long-memory 
time series, the estimation of the fractional parameter based on different 
choice of the bandwidth may be an additional tool when using semiparametric 
approaches to estimate the fractional parameters. This is exemplified in 
Table [6j The estimates of the memory parameters were calculated using 
different bandwidths m = n a , a = 0.35(0.3), .., max, where m satisfies the 
condition previously stated. For each a, the corresponding total number 
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of frequencies used in the regression is given in parenthesis. Table E] also 
displays the estimates and their empirical mse-the square of the bias plus 
the OLS variance. The smallest value of mse is given in bold. 

Table 6: Estimated parameters of Models I and II. 





Estim. 


a 






0.35 


0.38 


0.41 


0.44 


0.47 
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0.3700 
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0.3284 
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0.3021 


0.3133 




mse(di) 


0.0257 


0.0189 


0.0135 


0.0102 


0.0076 


0.0058 
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mse(d2) 


0.0205 


0.0108 


0.0073 


0.0043 
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0.0022 
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di 
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0.0997 


0.0887 


0.1449 


0.2535 


04 = 0.3 


d 2 


0.3138 


0.3715 


0.3139 


0.3187 


0.3199 


0.3144 


0.2758 




mse( di) 


0.0293 


0.0229 


0.0241 


0.0115 


0.0084 


0.0086 


0.0255 




mse (d 2 ) 


0.0094 


0.0125 


0.0057 


0.0044 


0.0035 


0.0028 


0.0023 
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Figure 5: (a) mse's estimates of the fractional parameters of Model I (b) 
mse's estimates of the fractional parameters of Model II. 

As was expected, the presence of seasonal and nonseasonal short-memory 
components may bias the estimates of the fractional parameters, which is 
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in accordance with the simulation results presented in Section 4. The bias 
may be reduced by an appropriate choice of the bandwidth, however, it is 
not easy task in a real practical application. So, looking at the behavior of 
the estimates across different bandwidth values may, at least, indicate the 
unfavorable estimates. In the samples here considered, it can be observed 
that when there is no short-memory part (Model I), the estimates are, in 
general, very stable across the bandwidth. The reduction of the variance 
and, also, the mse is obtained by increasing m. 

In Model II the seasonal period of the short-memory is s = 4, so the 
corresponding fractional estimate is more affected, whereas the fractional 
estimate of period s — 12 remains more stable in a wide range of bandwidths. 
Now, the smallest mse of the estimates are not at the same bandwidths. 
Since the estimate of d\ is more affected with the AR part, its estimate has 
the smallest mse with a smaller number of regression than the estimate of 
d,2- To have a better understanding of the behavior of the mse across the 
size of the bandwidth, these values are displayed in Figure [5j So, from this 
simple example it can be seen that the bias of each fractional estimate may 
be substantially affected, if at the same seasonal period, there is a short- 
memory component. As an example of a stronger correlation AR seasonal 
structure, a SARFIMA model with 4 = 0.8 was also considered, but it is 
not presented here to save space. As expected, the smallest mse of both 
seasonal fractional estimates were achieved for bandwidths smaller than the 
case where 04 = 0.3. 

To conclude, in Table [6] the estimates based on the smallest mse were 
used to estimate the fractional parameters of the artificial series. The model 
adequacies for the adjusted models were carried out, for example, the residual 
analysis. These evidenced that the estimated models fit the series well, that 
is, no anomaly of the residuals were found (residual analysis of the artificial 
data are available upon-request). 

In the same direction of the above exercises, other single series were also 
analyzed with different short-memory parameters and seasonal periods, how- 
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ever, in general, the estimates presented similar patterns of those here pre- 
sented. These are available upon-request. 

5.2 Daily average PMiq concentration 

The daily average Particulate Matter (PM 10 ) concentration is expressed in 
/ig/m 3 and it was observed in the Metropolitan Region of Greater Vitoria 
(RGV) in Brazil. RGV is comprised of five cities with a population of ap- 
proximately 1.7 million inhabitants in an area of 1,437 km 2 . The region is 
situated on the South Atlantic coast of Brazil (latitude 20°19S, longitude 
40°20W) and has a tropical humid climate, with average temperatures rang- 
ing from 24°C to 30°C. The rainfall is fairly distributed throughout the 
entire year (average precipitation of 98.3 mm per month during the period 
of study), but with drier periods from June to August (average precipita- 
tion of 60.8 mm per month) and more heavier precipitation from October to 
January (average precipitation of 158.3 mm per month). 

The raw series has a sample size of 2037 observations, measured from 
the 1st of January 2001 to 2nd of August 2006, and it is shown graphically 
in Figure EJ The sample autocorrelation (ACF) and partial autocorrelation 
(PACF) functions are shown in Figures [7] (a) and (b), respectively. From 
these plots a strong seasonal component in the series is evident, which was 
an expected property due to the characteristic of such a physical phenomena. 
It is also observed that the seasonality behavior has period s — 7, which is 
also an expected data behavior since the series was observed daily. 

An interesting feature observed from the sample ACF is the slow decay 
of the correlations in the first lags, in the lags multiple of 7 and in the 
lags between the seasonal periods. The ACF plot strongly indicates that 
the process has fractional memory parameters in the lung-run and in the 
seasonal periods. This empirical evidence indicates the use of a particular 
case of the SARFIMA model defined previously (Model ([7])) with si = 1, 
s 2 = 7. The modeling strategy follows the same steps suggested in Hosking 
(1981) and investigated empirically by Reisen (1994), Reisen & Lopes (1999) 
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among others. Firstly, the fractional parameters are estimated by using the 
GPH semiparametric tool described in the previous section. This was carried 
out by using different sizes of bandwidth m. Secondly, the truncated filter 
(1 — B) dl (l — B s ) d2 is used to filter the observation and obtain a new series 
which approximately follows an ARMA model. This new series is used to 
achieve the complete short-memory model structure. 




2001 2002 2003 2004 2005 

time 

Figure 6: PM 10 series. 
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Figure 7: (a) Sample ACF of PM 10 (b) Sample PACF of PM 
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Table [7] displays the results of the memory estimates obtained from differ- 
ent values of the bandwidth m = n a ,0<a<l and the values in parenthesis 
are the corresponding number of the frequency used in the regression. From 
this table, it can be seen that the values of the estimates of d\ and d>2 are stable 
for 0.52 < a < 0.65(max.), and they are in the range < d±,d 2 < 0.5. The 
estimated standard errors of di are relatively small and two-sided confidence 
intervals for d\ and d 2 are correspondingly tight. Therefore, for a > 0.52 
the null hypotheses that H : di = and H : <i 2 = are rejected. Also, 
for all values of the bandwidths given in the table, F test was performed for 
the null hypothesis H : d = 0, and it indicated that at least one fractional 
parameter is different from zero. The stable value of the estimate of d\ in the 
the range 0.52 < a < 0.65(max.) gives an empirical evidence that if there 
is any non-seasonal short-memory part in the model, the parameter is not 
large enough to make a significant contribution in the regression estimators. 
A similar conclusion is also observed in the case of the seasonal fractional 
estimate d 2 . Therefore, a = 0.54 was chosen to estimate the memory pa- 
rameters. The vector d = (0.1918, 0.1798) shows that data presents the 
stationarity, invertibility and long-memory properties. The choice of these 
estimates was also confirmed by the Akaike Criterion (AIC), which gave the 
smallest value for a = 0.54. 

Table 7: Estimates of the fractional parameters of the PM\q. 



Estim. 


a 




0.52 


0.54 


0.56 


0.58 


0.6 


0.65(max.) 




(361) 


(424) 


(494) 


(578) 


(669) 


(1016) 


di 


0.1004 


0.1918 


0.1787 


0.2071 


0.1645 


0.2534 


d 2 


0.1954 


0.1798 


0.1575 


0.1443 


0.1548 


0.0806 


Var d\ 


0.0110 


0.0090 


0.0072 


0.0060 


0.0049 


0.0014 


Var d 2 


0.0016 


0.0013 


0.0011 


0.0009 


0.0008 


0.0002 
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To obtain the approximation of the model v t , the observations were 
filtered by V d truncated at n=2037. The new series is u t = 2^j=o^j^-i> 
where n*, j = 1, 2, . . . , 2037, are the estimated coefficients of the AR(oo) 
representation of a SARFIMA(0, d±, 0)(0, d 2 , 0)7 model. As an example to 
verify the impact of Xj, for large j, in the AR infinite representation, the 
7r* 31 is ~ 10 -6 , which is nearly zero. Since the observations are in scale of 
10 2 , the contribution of Xj becomes negligible for large j. 

Figures |8]^a) and (b) present the sample autocorrelation and partial au- 
tocorrelation functions of £> t , respectively. These plots possibly indicate that 
an MA(1) model may be adequate to describe v t . However, the MA estimate 
does not seem to have significant value. This is in accordance with the stable 
values of the memory estimates given in Table [71 




Figure 8: (a) ACF of v t (b) PACF of v t . 



To identify the model's order of z> f , the AIC Criterion was used which sug- 
gested an MA(1) model. Therefore, the model SARFIMA(0, d 1 , 1) x (0, d 2 , 0) 7 
with 9 = —0.2673 (sd = 0.0214) was chosen for the PM W average data. The 
standard residual analysis did not present anomaly of the residuals ( the re- 
sults are upon-request). Most of the correlations of the residuals fall inside 
the confidence boundaries ( figures available upon-request). 
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6 Conclusions 



The paper deals with the seasonal ARFIMA model with two seasonal frac- 
tional parameters. Properties and model estimation are discussed. To esti- 
mate the parameters, a multilinear regression method is used. A parametric 
estimator was also considered for empirical comparison. The Monte Carlo 
experiment evidenced that, in general, all methods gave good estimates and 
they were very competitive. The estimators presented very good accuracy 
for sample size equal to 1080. The method is very easy to be implemented 
and does not require sophisticated computer capacities. The usefulness of 
the SARFIM A model and the semiparmetric fractional estimator was exem- 
plified using artificial and a daily average PMi concentration series. 
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APPENDIX A 



Proof of Theorem 1: The asymptotic mean and variance of d follows as 
in Theorem 1 in Hurvich et al (1998). Denote Z the Ylk m k x 2 matrix with 
the regressors in (|9]) and similarly the vector V for the disturbances. Then 



d-d = (Z'Z)- l Z'V. 



Note now that 
21ogX 1)feJ = 

2\ogX 2Xj = 
if k 6 ife and 

2 log X 2 , k ,j = 
if k $ If.. Then 



2 log < 2 sin ( nk 



1TJS 



n 



2 log < 2 sin 



7lks 2 



21og|A jV | +0(|A jV | 2 ) 
= 21og|A, S2 | + 0(|A, v | 2 : 



2 log < 2 sin 



irks 2 



1 + co S (rt S2 / S >b> 2 +Q 11 
sm(7r/cs 2 /s / ) n 3 2 J J 



[ S '/2] * 

S z l fcj 

fc=0 j 

[a'/2] * 

fc=0 j 
[s>/2] * 

k=0 j 



[s'/2] 

4^m fc (l + o(l)) 

fc=0 

4^m fc (l + o(l)) 

4^m fc (l + o(l)) 

fce7 fe 



This result follows from the fact that for those k (jL Ik, ^* -Zf = 0(m 3 n 2 ) = 
o(m) and J^* Z 2 .k,jZi,k.j = 0(m 2 n~ 1 \ogm) = o(m). Then 

Z'Z = mQ(l + o(l)) (15) 

Denoting now £ the vector with elements we have that 

Z'e = mb n (l + o(l)) (16) 
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since 



[s'/2] * 
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[J/2] * 

y^ z 2,kj£kj 

k=0 j 

because for k ^ Ik 



[s'/2] 

-2m Mk(2 



7T 



fc=0 



-2m^Mfc(27r)^ 



(a* + I) 2 V 

dk 



/my 
iogm ^ — J 



m\ a k 
n 



1 + 



logm 



n 



7^ ^ Z i,kj e Ki 



o El*. 



o m 



n 



"A 



The rest of the proof follows as in Hurvich et al (1998). 

Proof of Theorem 2: The proof follows as in Hurvich et al (1998) 
applying Lemma 4 in Sun and Phillips (2003) which holds in our multiple 
log periodogram regression context. Since 

Vm(tZ- d) = {m- x Z'Zy x m- xj2 Z'e + (m^Z'Z^m^Z'U 

by using (ITST) and ffT6l) it only remains to show that m~ l l 2 v' Z'U -4- iV(0, ir 2 v'Qv/6) 
for any vector i> = (vi, v%). As in Hurvich et al. (1998) 

j j [«72] 

V fc=0 |j|>m°- 5 +* 

for some 0.5 > 5 > and = ^i^i,fe,j + ^2^2, fcj- Now max Jjfc |gf fc j| = 
O(logm) and ^*j| >m o.5+i |<7fcj| p = 0(m) for all p > 1 (see formula (A18) 
in Hurvich et al (1998) for Zi^j and ^2,fc,j for ks 2 G and use (5) for 
ks 2 h)- Since by equation (JT5J) Z)m> m o. s+ « fi^j = mv'Qv(l + o(l)), we can 
apply Lemma 4 in Sun and Phillips (2003) to get the desired result. 
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